[Jul-2021] Databricks Databricks-Certified-Professional-Data-Scientist Dumps – Reduce Your Chance of Failure in Databricks-Certified-Professional-Data-Scientist Exam
To help you achieve your ultimate goal, we suggest the actual Databricks Databricks-Certified-Professional-Data-Scientist dumps for your Databricks Certified Professional Data Scientist Exam exam preparation to use as your guideline.
NEW QUESTION 34
Regularization is a very important technique in machine learning to prevent over fitting. And Optimizing with a L1 regularization term is harder than with an L2 regularization term because
- A. The second derivative is not constant
- B. The constraints are quadratic
- C. The objective function is not convex
- D. The penalty term is not differentiate
Answer: D
Explanation:
Explanation
Regularization is a very important technique in machine learning to prevent overfitting. Mathematically speaking, it adds a regularization term in order to prevent the coefficients to fit so perfectly to overfit. The difference between the L1 and L2 is just that L2 is the sum of the square of the weights, while L1 is just the sum of the weights.
Much of optimization theory has historically focused on convex loss functions because they're much easier to optimize than non-convex functions: a convex function over a bounded domain is guaranteed to have a minimum, and it's easy to find that minimum by following the gradient of the function at each point no matter where you start. For non-convex functions, on the other hand, where you start matters a great deal; if you start in a bad position and follow the gradient, you're likely to end up in a local minimum that is not necessarily equal to the global minimum.
You can think of convex functions as cereal bowls: anywhere you start in the cereal bowl, you're likely to roll down to the bottom. A non-convex function is more like a skate park: lots of ramps, dips, ups and downs. It's a lot harder to find the lowest point in a skate park than it is a cereal bowl.
NEW QUESTION 35
A denote the event 'student is female' and let B denote the event 'student is French'. In a class of 100 students suppose 60 are French, and suppose that 10 of the French students are females. Find the probability that if I pick a French student, it will be a girl, that is, find P(A|B).
- A. 1/6
- B. 2/3
- C. 1/3
- D. 2/6
Answer: A
Explanation:
Explanation
Since 10 out of 100 students are both French and female, then
P(AandB)=10100
Also. 60 out of the 100 students are French, so
P(B)=60100
So the required probability is:
P(A|B)=P(AandB)P(B)=10/10060/100=16
NEW QUESTION 36
You are working in an ecommerce organization, where you are designing and evaluating a recommender system, you need to select which of the following metric wilt always have the largest value?
- A. Root Mean Square Error
- B. Information is not good enough.
- C. Both land 2
- D. Sum of Errors
- E. Mean Absolute Error
Answer: B
NEW QUESTION 37
You are using one approach for the classification where to teach the agent not by giving explicit categorizations, but by using some sort of reward system to indicate success, where agents might be rewarded for doing certain actions and punished for doing others. Which kind of this learning
- A. Supervised
- B. Unsupervised
- C. None of the above
- D. Regression
Answer: B
Explanation:
Explanation
Unsupervised learning seems much harder: the goal is to have the computer learn how to do something that we don't tell it how to do! The approach is to teach the agent not by giving explicit categorizations, but by using some sort of reward system to indicate success. Note that this type of training will generally fit into the decision problem framework because the goal is not to produce a classification but to make decisions that maximize rewards. This approach nicely generalizes to the real world, where agents might be rewarded for doing certain actions and punished fordoing others.
NEW QUESTION 38
You are creating a Classification process where input is the income, education and current debt of a customer, what could be the possible output of this process.
- A. Percentage of the customer loan repayment capability
- B. Percentage of the customer should be given loan or not
- C. Probability of the customer default on loan repayment
- D. The output might be a risk class, such as "good", "acceptable", "average", or "unacceptable".
Answer: D
Explanation:
Explanation
Classification is the process of using several inputs to produce one or more outputs. For example the input might be the income, education and current debt of a customer The output might be a risk class, such as
"good", "acceptable", "average", or "unacceptable". Contrast this to regression where the output is a number not a class.
NEW QUESTION 39
You are designing a recommendation engine for a website where the ability to generate more personalized recommendations by analyzing information from the past activity of a specific user, or the history of other users deemed to be of similar taste to a given user. These resources are used as user profiling and helps the site recommend content on a user-by-user basis. The more a given user makes use of the system, the better the recommendations become, as the system gains data to improve its model of that user. What kind of this recommendation engine is ?
- A. Logistic Regression
- B. Collaborative filtering
- C. Naive Bayes classifier
- D. Content-based filtering
Answer: B
Explanation:
Explanation
Another aspect of collaborative filtering systems is the ability to generate more personalized recommendations by analyzing information from the past activity of a specific user, or the history of other users deemed to be of similar taste to a given user. These resources are used as user profiling and help the site recommend content on a user-by-user basis. The more a given user makes use of the system, the better the recommendations become, as the system gains data to improve its model of that user
NEW QUESTION 40
In which phase of the analytic lifecycle would you expect to spend most of the project time?
- A. Discovery
- B. Communicate Results
- C. Data preparation
- D. Operationalize
Answer: C
Explanation:
Explanation
In the data preparation phase of the Data Analytics Lifecycle, the data range and distribution can be obtained.
If the data is skewed, viewing the logarithm of the data (if it's all positive) can help detect structures that might otherwise be overlooked in a graph with a regular, nonlogarithmic scale.
When preparing the data, one should look for signs of dirty data, as explained in the previous section. Examining if the data is unimodal or multimodal will give an idea of how many distinct populations with different behavior patterns might be mixed into the overall population. Many modeling techniques assume that the data follows a normal distribution. Therefore, it is important to know if the available dataset can match that assumption before applying any of those modeling techniques.
NEW QUESTION 41
In which phase of the data analytics lifecycle do Data Scientists spend the most time in a project?
- A. Discovery
- B. Communicate Results
- C. Model Building
- D. Data Preparation
Answer: D
NEW QUESTION 42
Select the correct option which applies to L2 regularization
- A. Computational efficient due to having analytical solutions
- B. No feature selection
- C. Non-sparse outputs
Answer: A,B,C
Explanation:
The difference between their properties can be promptly summarized as follows:
Table Description automatically generated
NEW QUESTION 43
Consider flipping a coin for which the probability of heads is p, where p is unknown, and our goa is to estimate p. The obvious approach is to count how many times the coin came up heads and divide by the total number of coin flips. If we flip the coin 1000 times and it comes up heads 367 times, it is very reasonable to estimate p as approximately 0.367. However, suppose we flip the coin only twice and we get heads both times.
Is it reasonable to estimate p as 1.0? Intuitively, given that we only flipped the coin twice, it seems a bit rash to conclude that the coin will always come up heads, and____________is a way of avoiding such rash conclusions.
- A. Logistic Regression
- B. Laplace Smoothing
- C. Linear Regression
- D. Naive Bayes
Answer: B
Explanation:
Explanation
Smooth the estimates: consider flipping a coin for which the probability of heads is p, where p is unknown, and our goal is to estimate p. The obvious approach is to count how many times the coin came up heads and divide by the total number of coin flips. If we flip the coin 1000 times and it comes up heads 367 times, it is very reasonable to estimate p as approximately 0.367. However, suppose we flip the coin only twice and we get heads both times. Is it reasonable to estimate p as 1.0? Intuitively, given that we only flipped the coin twice, it seems a bit rash to conclude that the coin will always come up heads, and smoothing is a way of avoiding such rash conclusions. A simple smoothing method, called Laplace smoothing (or Laplace's law of succession or add-one smoothing in R&N), is to estimate p by (one plus the number of heads) / (two plus the total number of flips). Said differently, if we are keeping count of the number of heads and the number of tails, this rule is equivalent to starting each of our counts at one, rather than zero. Another advantage of Laplace smoothing is that it avoids estimating any probabilities to be zero, even for events never observed in the data.
Laplace add-one smoothing now assigns too much probability to unseen words
NEW QUESTION 44
Suppose that the probability that a pedestrian will be tul by a car while crossing the toad at a pedestrian crossing without paying attention to the traffic light is lo be computed. Let H be a discrete random variable taking one value from (Hit. Not Hit). Let L be a discrete random variable taking one value from (Red. Yellow.
Green).
Realistically, H will be dependent on L That is, P(H = Hit) and P(H = Not Hit) will take different values depending on whether L is red, yellow or green. A person is. for example, far more likely to be hit by a car when trying to cross while Hie lights for cross traffic are green than if they are red In other words, for any given possible pair of values for Hand L. one must consider the joint probability distribution of H and L to find the probability* of that pair of events occurring together if Hie pedestrian ignores the state of the light Here is a table showing the conditional probabilities of being bit. defending on ibe stale of the lights (Note that the columns in this table must add up to 1 because the probability of being hit oi not hit is 1 regardless of the stale of the light.)
- A. marginal probability that P(H=Not Hit) is the sum of the H= Hit row
- B. marginal probability that P(H=Not Hit) is the sum of the H=Not Hit row
- C. The marginal probability P(H=Hit) is the sum along the H=Hit row of this joint distribution table, as this is the probability of being hit when the lights are red OR yellow OR green.
Answer: B,C
Explanation:
Explanation
The marginal probability P(H=Hit) is the sum along the H=Hit row of this joint distribution table, as this is the probability of being hit when the lights are red OR yellow OR green. Similarly, the marginal probability that P(H=Not Hit) is the sum of the H=Not Hit row
NEW QUESTION 45
Select the correct statement which applies to logistic regression
- A. All 1, 2 and 3 are correct
- B. Works with Numeric values
- C. May have low accuracy
- D. Only 1 and 3 are correct
- E. Computationally inexpensive, easy to implement knowledge representation easy to interpret
Answer: A
Explanation:
Explanation
Depending on the size of the data you are uploading, Amazon S3 offers the following options:
Logistic regression
Pros: Computationally inexpensive, easy to implement knowledge representation easy to interpret Cons: Prone to underfitting, may have low accuracy Works with: Numeric values^ nominal values
NEW QUESTION 46
You have used k-means clustering to classify behavior of 100, 000 customers for a retail store. You decide to use household income, age, gender and yearly purchase amount as measures. You have chosen to use 8 clusters and notice that 2 clusters only have 3 customers assigned. What should you do?
- A. Identify additional measures to add to the analysis
- B. Decrease the number of measures used
- C. Increase the number of clusters
- D. Decrease the number of clusters
Answer: D
Explanation:
Explanation
kmeans uses an iterative algorithm that minimizes the sum of distances from each object to its cluster centroid, over all clusters. This algorithm moves objects between clusters until the sum cannot be decreased further. The result is a set of clusters that are as compact and well-separated as possible. You can control the details of the minimization using several optional input parameters to kmeans, including ones for the initial values of the cluster centroids, and for the maximum number of iterations.
Clustering is primarily an exploratory technique to discover hidden structures of the data: possibly as a prelude to more focused analysis or decision processes. Some specific applications of k-means are image processing^ medical and customer segmentation. Clustering is often used as a lead-in to classification. Once the clusters are identified, labels can be applied to each cluster to classify each group based on its characteristics. Marketing and sales groups use k-means to better identify customers who have similar behaviors and spending patterns.
NEW QUESTION 47
You have collected the 100's of parameters about the 1000's of websites e.g. daily hits, average time on the websites, number of unique visitors, number of returning visitors etc. Now you have find the most important parameters which can best describe a website, so which of the following technique you will use
- A. Logistic Regression
- B. Clustering
- C. PCA (Principal component analysis)
- D. Linear Regression
Answer: C
Explanation:
Explanation
Principal component analysis . or PCA, is a technique for taking a dataset that is in the form of a set of tuples representing points in a high-dimensional space and finding the dimensions along which the tuples line up best. The idea is to treat the set of tuples as a matrix M and find the eigenvectors for MMT or M T M . The matrix of these eigenvectors can be thought of as a rigid rotation in a high-dimensional space. When you apply this transformation to the original data, the axis corresponding to the principal eigenvector is the one along which the points are most "spread out,11 More precisely this axis is the one along which the variance of the data is maximized. Put another way, the points can best be viewed as lying along this axis, with small deviations from this axis.
NEW QUESTION 48
You are creating a model for the recommending the book at Amazon.com, so which of the following recommender system you will use you don't have cold start problem?
- A. User-based collaborative filtering
- B. Content-based filtering
- C. Item-based collaborative filtering
- D. Naive Bayes classifier
Answer: B
Explanation:
Explanation
The cold start problem is most prevalent in recommender systems. Recommender systems form a specific type of information filtering (IF) technique that attempts to present information items (movies, music, books, news, images, web pages) that are likely of interest to the user. Typically, a recommender system compares the user's profile to some reference characteristics. These characteristics may be from the information item (the content-based approach) or the user's social environment (the collaborative filtering approach). In the content-based approach, the system must be capable of matching the characteristics of an item against relevant features in the user's profile. In order to do this, it must first construct a sufficiently-detailed model of the user's tastes and preferences through preference elicitation. This may be done either explicitly (by querying the user) or implicitly (by observing the user's behaviour). In both cases, the cold start problem would imply that the user has to dedicate an amount of effort using the system in its 'dumb' state - contributing to the construction of their user profile - before the system can start providing any intelligent recommendations.
Content-based filtering recommender systems use information about items or users to make recommendations, rather than user preferences, so it will perform well with little user preference data. Item-based and user-based collaborative filtering makes predictions based on users' preferences for items, os they will typically perform poorly with little user preference data. Logistic regression is not recommender system technique.
NEW QUESTION 49
Spam filtering of the emails is an example of
- A. Clustering
- B. 2 and 3 are correct
- C. Unsupervised learning
- D. Supervised learning
- E. 1 and 3 are correct
Answer: D
Explanation:
Explanation
Clustering is an example of unsupervised learning. The clustering algorithm finds groups within the data without being told what to look for upfront. This contrasts with classification, an example of supervised machine learning, which is the process of determining to which class an observation belongs. A common application of classification is spam filtering. With spam filtering we use labeled data to train the classifier:
e-mails marked as spam or ham.
NEW QUESTION 50
Which of the following question statement falls under data science category?
- A. How many products have been sold in a last month?
- B. Which is the optimal scenario for selling this product?
- C. What happens, if these scenario continues?
- D. Where is a problem for sales?
- E. What happened in last six months?
Answer: B,C
Explanation:
Explanation
This question wants to check your understanding about Bl and Data Science. Bl was already existing and analytics team already using it. They need to improve and learn data science technique to solve some problems. If you check the option given in the question, it will confuse you. But if you have worked in Bl or as a Data Scientist then it is easy to answer. First 3 option can be easily answered using reporting solution, what sales happened in last six month, what was the problem etc.
But for the last two option you need to apply data science techniques like which all scenarios are optimal for product sales, you need to collect the data and applying various techniques for that. Hence, last two option can only be answered using Data Science technique And for this you need to apply techniques like Optimization, predictive modeling, statistical analysis on structured and un-structured data.
NEW QUESTION 51
You have modeled the datasets with 5 independent variables called A,B,C,D and E having relationships which is not dependent each other, and also the variable A,B and C are continuous and variable D and E are discrete (mixed mode).
Now you have to compute the expected value of the variable let say A, then which of the following computation you will prefer
- A. Integration
- B. Differentiation
- C. Generalization
- D. Transformation
Answer: A
Explanation:
Explanation
Text Description automatically generated
Text Description automatically generated
Text Description automatically generated
NEW QUESTION 52
Marie is getting married tomorrow, at an outdoor ceremony in the desert. In recent years, it has rained only 5 days each year. Unfortunately, the weatherman has predicted rain for tomorrow. When it actually rains, the weatherman correctly forecasts rain 90% of the time. When it doesn't rain, he incorrectly forecasts rain 10% of the time. Which of the following will you use to calculate the probability whether it will rain on the day of Marie's wedding?
- A. Logistic Regression
- B. Naive Bayes
- C. All of the above
- D. Random Decision Forests
Answer: B
Explanation:
Explanation
The sample space is defined by two mutually-exclusive events - it rains or it does not rain. Additionally, a third event occurs when the weatherman predicts rain. You should consider Bayes' theorem when the following conditions exist.
* The sample space is partitioned into a set of mutually exclusive events {A1, A2,... :An}.
* Within the sample space, there exists an event B: for which P(B) > 0.
* The analytical goal is to compute a conditional probability of the form: P( Ak B).
NEW QUESTION 53
You are working in a classification model for a book, written by HadoopExam Learning Resources and decided to use building a text classification model for determining whether this book is for Hadoop or Cloud computing. You have to select the proper features (feature selection) hence, to cut down on the size of the feature space, you will use the mutual information of each word with the label of hadoop or cloud to select the 1000 best features to use as input to a Naive Bayes model. When you compare the performance of a model built with the 250 best features to a model built with the 1000 best features, you notice that the model with only 250 features performs slightly better on our test data.
What would help you choose better features for your model?
- A. Include the number of times each of the words appears in the book in your model
- B. Evaluate a model that only includes the top 100 words
- C. Decrease the size of our training data
- D. Include least mutual information with other selected features as a feature selection criterion
Answer: D
Explanation:
Explanation
Correlation measures the linear relationship (Pearson's correlation) or monotonic relationship (Spearman's correlation) between two variables, X and Y.
Mutual information is more general and measures the reduction of uncertainty in Y after observing X.
It is the KL distance between the joint density and the product of the individual densities. So Ml can measure non-monotonic relationships and other more complicated relationships Mutual information is a quantification of the dependency between random variables. It is sometimes contrasted with linear correlation since mutual information captures nonlinear dependence.
Features with high mutual information with the predicted value are good. However a feature may have high mutual information because it is highly correlated with another feature that has already been selected.
Choosing another feature with somewhat less mutual information with the predicted value, but low mutual information with other selected features, may be more beneficial. Hence it may help to also prefer features that are less redundant with other selected features.
NEW QUESTION 54
Which method is used to solve for coefficients bO, b1, ... bn in your linear regression model:
- A. Apriori Algorithm
- B. Ridge and Lasso
- C. Integer programming
- D. Ordinary Least squares
Answer: D
Explanation:
Explanation : RY = b0 + b1x1+b2x2+ .... +bnxn
In the linear model, the bi's represent the unknown p parameters. The estimates for these unknown parameters are chosen so that, on average, the model provides a reasonable estimate of a person's income based on age and education. In other words, the fitted model should minimize the overall error between the linear model and the actual observations. Ordinary Least Squares (OLS) is a common technique to estimate the parameters
NEW QUESTION 55
Which of the following are advantages of the Support Vector machines?
- A. Effective in cases where number of dimensions is greater than the number of samples
- B. SVMs directly provide probability estimates
- C. it is memory efficient
- D. possible to specify custom kernels
- E. Effective in high dimensional spaces.
- F. Number of features is much greater than the number of samples, the method still give good performances
Answer: A,C,D,E
Explanation:
Explanation
Support vector machines (SVMs) are a set of supervised learning methods used for classification, regression and outliers detection.
The advantages of support vector machines are:
Effective in high dimensional spaces.
Still effective in cases where number of dimensions is greater than the number of samples.
Uses a subset of training points in the decision function (called support vectors), so it is also memory efficient.
Versatile: different Kernel functions can be specified for the decision function.
Common kernels are provided, but it is also possible to specify custom kernels.
The disadvantages of support vector machines include:
If the number of features is much greater than the number of samples, the method is likely to give poor performances.
SVMs do not directly provide probability estimates, these are calculated using an expensive five-fold cross-validation.
NEW QUESTION 56
......
Accurate & Verified Answers As Seen in the Real Exam here: https://www.testkingfree.com/Databricks/Databricks-Certified-Professional-Data-Scientist-practice-exam-dumps.html